On Bootstrapping the ROC Curve
نویسندگان
چکیده
This paper is devoted to thoroughly investigating how to bootstrap the ROC curve, a widely used visual tool for evaluating the accuracy of test/scoring statistics in the bipartite setup. The issue of confidence bands for the ROC curve is considered and a resampling procedure based on a smooth version of the empirical distribution called the ”smoothed bootstrap” is introduced. Theoretical arguments and simulation results are presented to show that the ”smoothed bootstrap” is preferable to a ”naive” bootstrap in order to construct accurate confidence bands.
منابع مشابه
On constructing accurate confidence bands for ROC curves through smooth resampling
This paper is devoted to thoroughly investigating how to bootstrap the ROC curve, a widely used visual tool for evaluating the accuracy of test/scoring statistics s(X) in the bipartite setup. The issue of confidence bands for the ROC curve is considered and a resampling procedure based on a smooth version of the empirical distribution called the ”smoothed bootstrap” is introduced. Theoretical a...
متن کاملA predictive model for respiratory syncytial virus (RSV) hospitalisation of premature infants born at 33–35 weeks of gestational age, based on data from the Spanish FLIP study
BACKGROUND The aim of this study, conducted in Europe, was to develop a validated risk factor based model to predict RSV-related hospitalisation in premature infants born 33-35 weeks' gestational age (GA). METHODS The predictive model was developed using risk factors captured in the Spanish FLIP dataset, a case-control study of 183 premature infants born between 33-35 weeks' GA who were hospi...
متن کاملNonparametric estimation of conditional ROC curves: Application to discrimination tasks in computerized detection of early breast cancer
A local linear method for estimating the conditional ROC curve under the presence of continuous and categorical covariates has been introduced in this paper. A data driven smoothing parameter has been proposed via the bootstrap method. The methods have been illustrated with real data coming from a discrimination problem emerging in the context of a computer-aided diagnosis system. The bootstrap...
متن کاملValidation of Two-Sample Bootstrap in ROC Analysis on Large Datasets Using AURC
Sampling variability results in uncertainties of measures. The nonparametric twosample bootstrap method has been used to compute uncertainties of measures in receiver operating characteristic (ROC) analysis on large datasets, such as the standard error (SE) of the equal error rate in biometrics, the SE of a detection cost function in speaker recognition evaluation, and others. Specifically, the...
متن کاملSemiparametric Inferential Procedures for Comparing Multivariate Roc Curves with Interaction Terms
Multivariate ROC curve models that include an interaction term between biomarker type and false positive rate are important in comparative biomarker studies, because such interaction allows ROC curves of different biomarkers to cross each other. However, there has been limited work in drawing inference for comparing multivariate ROC curves, especially when interaction terms are present. In this...
متن کامل